Operation processing device, operation processing method, and program

ABSTRACT

There is provided an operation processing device including an input direction acquisition unit configured to acquire information indicating an input direction according to a direction generated in response to an operation indicating the direction which is performed on an input unit to which the operation is input, an output direction indication unit configured to indicate, to a display unit configured to display an image, an output direction that is a direction in which the image of the display unit is changed in response to the operation on the input unit, and a determination unit configured to determine an orientation of the output direction with respect to the input direction according to a relative position relationship between the input unit and the display unit.

CROSS REFERENCE PARAGRAPH

The present application is a continuation application of U.S. patentapplication Ser. No. 15/866,519, filed Jan. 10, 2018, which is acontinuation application of U.S. patent application Ser. No. 14/409,620,filed Dec. 19, 2014, now U.S. Pat. No. 9,891,729, which is a NationalStage Entry of PCT/JP2013/068081, filed Jul. 2, 2013, and claims thebenefit of priority from prior Japanese Patent Application JP2012-154229, filed Jul. 10, 2012, the entire content of which is herebyincorporated by reference.

TECHNICAL FIELD

The present disclosure relates to an information processing device, anoperation processing method, and a program, and in particular, to aninformation processing device, an information processing method, and aprogram, capable of providing an easier-to-use user interface.

BACKGROUND ART

In the related art, a device, such as a note-type personal computer,including a display unit, such as a liquid crystal panel, and an inputunit, such as a touch sensor, has been widely used. Typically, thenote-type personal computer is configured such that a relative anglebetween the display unit and the input unit is in a range of 0° to 180°(in practical, a range of 30° to 180°, such as 120°). Therefore, when auser performs a touch operation on the input unit, it is possible forthe user to perform the operation with no sense of incongruity byemploying a user interface in which an input direction on the input unitis the same as an output direction in which a display of the displayunit is changed.

On the other hand, the present applicant suggests a foldable typeelectronic device including a hinge part, in which the relative anglebetween the display unit and the input unit can have 180° or more (see,for example, Patent Literature 1).

In a case where such an electronic device uses a user interface in whichthe input direction and the output direction are the same direction, theuser may feel that the output direction with respect to the inputdirection is the opposite direction when a relative position is in arange of 180° to 360° (in particular, around 360°). A device in whichthe relative angle between the display unit and the input unit is fixedto 360°, that is, a device including the input unit disposed at a rearsurface side of the display unit uses a user interface in which theinput direction and the output direction are the same direction.

CITATION LIST Patent Literature

Patent Literature 1:

JP 2012-057662A

SUMMARY OF INVENTION Technical Problem

As mentioned above, when the user interface in which the input directionand the output direction are the same direction is used, it is difficultfor the user to perform an operation with no sense of incongruity sincethe user feels that the output direction with respect to the inputdirection is the opposite direction. Accordingly, there is a need for aneasier-to-use user interface that allows for an operation with no senseof incongruity.

The present disclosure has been made in view of this situation, and anobject thereof is to provide an easier-to-use user interface.

Solution to Problem

According to an aspect of the present disclosure, there is provided anoperation processing device including an input direction acquisitionunit configured to acquire information indicating an input directionaccording to a direction generated in response to an operationindicating the direction which is performed on an input unit to whichthe operation is input, an output direction indication unit configuredto indicate, to a display unit configured to display an image, an outputdirection that is a direction in which the image of the display unit ischanged in response to the operation on the input unit, and adetermination unit configured to determine an orientation of the outputdirection with respect to the input direction according to a relativeposition relationship between the input unit and the display unit.

According to an aspect of the present disclosure, there is provided aprogram for causing a computer to perform operation processing, theoperation processing including the steps of acquiring informationindicating an input direction according to a direction generated inresponse to an operation indicating the direction which is performed onan input unit to which the operation is input, indicating, to a displayunit configured to display an image, an output direction that is adirection in which the image of the display unit is changed in responseto the operation on the input unit, and determining an orientation ofthe output direction with respect to the input direction according to arelative position relationship between the input unit and the displayunit.

According to an aspect of the present disclosure, information indicatingan input direction according to a direction generated in response to anoperation indicating the direction which is performed on an input unitto which the operation is input, an output direction indication unitconfigured to indicate, to a display unit configured to display an imageis acquired. An output direction that is a direction in which the imageof the display unit is changed in response to the operation on the inputunit is indicated to a display unit configured to display an image. Inaddition, an orientation of the output direction with respect to theinput direction according to a relative position relationship betweenthe input unit and the display unit is determined.

ADVANTAGEOUS EFFECTS OF INVENTION

According to an aspect of the present disclosure, it is possible toprovide an easier-to-use user interface.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a perspective view illustrating an example configuration of afirst embodiment of a touch operation terminal to which the presenttechnology is applied.

FIG. 2 is a view explaining a horizontal direction and a verticaldirection in a touch operation terminal having a hinge part.

FIGS. 3A, 3B, 3C, and 3D are views explaining a relationship between aninput direction and an output direction.

FIG. 4 is a block diagram illustrating an example functionalconfiguration of an operation processing unit of a touch operationterminal.

FIG. 5 is a flowchart explaining operation processing.

FIGS. 6A and 6B are views explaining adjustment of a scroll speedaccording to a position relationship with a user.

FIGS. 7A and 7B are perspective views illustrating an exampleconfiguration of a second embodiment of a touch operation terminal towhich the present technology is applied.

FIG. 8 is a view illustrating a state in which a touch operationterminal is bent.

FIG. 9 is a view illustrating a menu screen displayed when a touchoperation terminal is bent.

FIG. 10 is a block diagram showing an example configuration of a firstembodiment of a computer to which the present technology is applied.

DESCRIPTION OF EMBODIMENTS

Hereinafter, specific embodiments to which the present technology isapplied will be described in detail with reference to the drawings.

FIG. 1 is a perspective view illustrating an example configurationaccording to a first embodiment of an information processing device towhich the present technology is applied.

Referring to FIG. 1, a touch operation terminal 11 includes a firsthousing 12, a second housing 13, a hinge part 14, an input unit 15, anda display unit 16.

The input unit 15 is disposed in one side surface of the first housing12, and the display unit 16 is disposed in the other side surface of thesecond housing 13. The first housing 12 and the second housing 13 areconnected to be openable and closable through the hinge part 14 suchthat the input unit 15 and the display unit 16 face each other in aclosed state. A relative position relationship between the first housing12 and the second housing 13 can be changed around the hinge part 14.

For example, the touch operation terminal 11 is configured such that arelative angle θ between a front surface of the input unit 15 of thefirst housing 12 and a front surface of the display unit 16 of secondhousing 13 is changeable in a range of 0° to 360° around the hinge part14. That is, the hinge part 14 connects the first housing 12 and thesecond housing 13 so as to be openable and closable in a range from anangle) (0°) at which the input unit 15 and the display unit 16 face eachother to an angle (360°) at which the input unit 15 and the display unit16 face opposite sides. Thus, the touch operation terminal 11 isconfigured such that the front surface of the input unit 15 of the firsthousing 12 and the front surface of the display unit 16 of the secondhousing 13 are openable to 180° or more as indicated by a relative angleθ′ in FIG. 1.

The input unit 15 detects a movement of a finger of a user by using, forexample, a change in pressure applied on a front surface by the fingerof the user or a change in static electricity due to contact on (orproximity to) the front surface of the finger of the user. For example,when the user performs an operation of indicating a direction by movingthe finger in an arbitrary direction whiling touching the surface withthe finger the input unit 15 (hereinafter, appropriately referred to asa swipe operation), the input unit 15 detects a movement of the fingerof the user and acquires operation information that indicates an inputdirection according to a movement direction of the finger.

The display unit 16 is configured to have, for example, a crystal panel,an organic electro luminescence panel or the like, and displays adisplay screen which is an image in which display contents areconfigured by a picture, a photograph, a figure, a character, agraphical user interface (GUI) and the like. For example, the displayunit 16 scrolls and displays the display screen or moves a pointer or acursor displayed on the display screen, in the output direction based onthe swipe operation of the user on the input unit 15 to change displayof the display screen.

The touch operation terminal 11 is configured as mentioned above, andthe user can adjust the first housing 12 and the second housing 13 so asto be a desired relative angle θ and use the touch operation terminal11. Also, when the user performs the swipe operation on the input unit15, the touch operation terminal 11 performs operation processingaccording to the swipe operation and controls the display of the displayscreen of the display unit 16, based on the operation informationacquired by the input unit 15. For example, when the user performs theswipe operation of moving the finger in a horizontal direction, thetouch operation terminal 11 performs operation processing such that thedisplay screen of the display unit 16 is scrolled in the horizontaldirection.

The touch operation terminal 11 performs a process of switching theoutput direction with respect to the input direction based on therelative angle θ between the first housing 12 and the second housing 13in an operation processing of a swipe operation in a vertical direction.

For example, it is assumed that a direction along the hinge part 14 is ahorizontal direction in the touch operation terminal 11 including thehinge part 14, as illustrated in FIG. 2. Also, it is assumed that adirection perpendicular to the horizontal direction and also,perpendicular to a normal direction α of the input unit 15 in a frontsurface of the input unit 15 and a direction perpendicular to thehorizontal direction and also, perpendicular to a normal direction β ofthe display unit 16 in a front surface of the display unit 16 are avertical direction. That is, the vertical direction is a straight linewhen the relative angle θ is 180° as illustrated in FIG. 2 and is curvedaccording to the relative angle θ when relative angle θ is an angleother than 180°.

Also, a predetermine range of the relative angle θ at which processingis performed such that the output direction with respect to the inputdirection is set in the touch operation terminal 11 with respect to aswipe operation in the vertical direction. The touch operation terminal11 can switch the output direction with respect to the input directiondepending on whether the relative angle θ is in the predetermined range.That is, the touch operation terminal 11 allows the output directionwith respect to the input direction to be the same direction when therelative angle θ is in the predetermined range, and allows the outputdirection with respect to the input direction to be the oppositedirection when the relative angle θ is not in the predetermined range.Additionally, the predetermined range is previously set by evaluating,for example, whether the user can perform the swipe operation with nosense of incongruity, in development stages.

Specifically, the predetermined range of 0° to 180° is set in the touchoperation terminal 11. Therefore, when the relative angle θ is in arange of 0° to 180° (0°≤θ≤180°), the touch operation terminal 11performs operation processing such that the output direction withrespect to the input direction is the same direction with respect to theswipe operation in the vertical direction. On the other hand, when therelative angle θ is greater than 180° and is less than or equal to 360°(180°<θ≤360°), the touch operation terminal 11 performs operationprocessing such that the output direction with respect to the inputdirection is the opposite direction with respect to the swipe operationin the vertical direction.

Note that the touch operation terminal 11 performs operation processingsuch that the input direction and the output direction are not switchedwith respect to the horizontal direction in spite of a change in therelative angle θ (that is, when the input direction is a rightdirection, the output direction is always the right direction). Also, aswipe operation in the vertical direction includes not only a movementof a finger which is completely matched with the vertical direction butalso a movement of the finger in a diagonal direction including acomponent of the vertical direction.

Next, the relationship between an input direction to the input unit 15and an output direction in the display unit 16 will be described withreference to FIGS. 3A, 3B, 3C, and 3D.

FIG. 3A illustrates the touch operation terminal 11 in which therelative angle θ is 90° and FIG. 3B illustrates the touch operationterminal 11 in which the relative angle θ is 180°. In FIG. 3C, there isillustrated the touch operation terminal 11 in which the relative angleθ is 270° and in FIG. 3D, there is illustrated the touch operationterminal 11 in which the relative angle θ is 360°.

In a case where the relative angle θ between the input unit 15 and thedisplay unit 16 is 90° as illustrated in FIG. 3A, the touch operationterminal 11 performs operation processing such that the output directionOUT with respect to the input direction IN is the same direction. In acase where the relative angle θ between the input unit 15 and thedisplay unit 16 is 180° as illustrated in FIG. 3B, the touch operationterminal 11 performs operation processing such that the output directionOUT with respect to the input direction IN is the same direction.

On the other hand, in a case where the relative angle θ between theinput unit 15 and the display unit 16 is 270° as illustrated in FIG. 3C,the touch operation terminal 11 performs operation processing such thatthe output direction OUT with respect to the input direction IN is theopposite direction. Also, in a case where the relative angle θ betweenthe input unit 15 and the display unit 16 is 360° as illustrated in FIG.3D, that is, the display unit 16 is disposed in the rear surface side ofthe input unit 15, the touch operation terminal 11 performs operationprocessing such that the output direction OUT with respect to the inputdirection IN is the opposite direction (in this case, the oppositedirection in a coordinate system in which the vertical direction iscurved according to the relative angle θ, as described with reference toFIG. 2).

Thus, the touch operation terminal 11 perform operation processing whichswitches the output direction with respect to the input direction to thesame direction or the opposite direction, depending on whether relativeangle θ is in a range of 0° to 180°.

Next, FIG. 4 is a block diagram illustrating an example functionalconfiguration of an operation processing unit of the touch operationterminal 11.

As illustrated in FIG. 4, the operation processing unit 21 includes aninput direction acquisition unit 22, a relative angle detection unit 23,an output direction determination unit 24, and a display instructionunit 25. Note that the operation processing unit 21 is configured by acentral processing unit (CPU) embedded in the touch operation terminal11, a read only memory (ROM), a random access memory (RAM), anon-volatile memory (for example, electronically erasable andprogrammable read only memory (EEPROM), or the like, and functions ofthe respective elements are realized when the CPU reads programs storedin the ROM or the non-volatile memory on the RAM and performs theprograms.

The input direction acquisition unit 22 is connected to the input unit15, and receives operation information from the input unit 15 on which auser performs a swipe operation and acquires an input direction in theswipe operation of the user, based on the operation information.

The relative angle detection unit 23 is connected to an angle sensor(not illustrated) attached to the hinge part 14 and detects a relativeangle θ between the first housing 12 and the second housing 13.

When the input direction acquisition unit 22 acquires the inputdirection, the output direction determination unit 24 determines theorientation of the output direction (same direction or oppositedirection) with respect to the input direction, based on the relativeangle θ detected by the relative angle detection unit 23. That is, theoutput direction determination unit 24 performs a process of switchingthe orientation of the output direction with respect to the inputdirection depending on whether the relative angle θ is in thepredetermined range. For example, the output direction determinationunit 24 determines the output direction with respect to the inputdirection to be the same direction, as mentioned above when the relativeangle θ is in the predetermined range (for example, 0°≤θ≤180°). On theother hand, the output direction determination unit 24 determines theoutput direction with respect to the input direction to be the oppositedirection when the relative angle θ is not in the predetermined range.

The display instruction unit 25 is connected to the display unit 16 andsupplies a control signal that instructs display of a display screen tothe display unit 16 such that display on the display screen of thedisplay unit 16 is changed in an output direction determined by theoutput direction determination unit 24. Therefore, the display unit 16switches, for example, a direction in which the display screen isscrolled to the same or opposite direction as the input directiondepending on whether the relative angle θ is in a predetermined range(for example, 0°≤θ≤180°).

The operation processing unit 21 is configured as mentioned above.According to the relative angle θ detected by the relative angledetection unit 23, the output direction is determined with respect tothe input direction acquired by the input direction acquisition unit 22and the display unit 16 is instructed to perform display in the outputdirection.

Next, FIG. 5 is a flowchart explaining operation processing which isperformed by the operation processing unit 21.

For example, the input unit 15 waits in a state capable of detecting atouch operation of a user and, when detecting that a swipe operation isperformed by the user, the processing is started. In step S11, the inputunit 15 supplies operation information acquired based on the swipeoperation of the user to the input direction acquisition unit 22. Theinput direction acquisition unit 22 acquires an input direction from theoperation information and supplies the input direction to the outputdirection determination unit 24.

In step S12, the relative angle detection unit 23 detects a relativeangle between the first housing 12 and the second housing 13 based on asignal that is output from the angle sensor (not illustrated) attachedto the hinge part 14 and supplies the relative angle to the outputdirection determination unit 24.

In step S13, the output direction determination unit 24 determineswhether the relative angle θ detected by the relative angle detectionunit 23 in step S12 is in the predetermined range.

In step S13, when it is determined that the relative angle θ is in thepredetermined range, the process proceeds to step S14, and the outputdirection determination unit 24 determines, as the output direction, thesame direction as the input direction acquired by the input directionacquisition unit 22 in step S11 and performs notification to the displayinstruction unit 25.

On the other hand, in step S13, when the relative angle θ is not in thepredetermined range, the process proceeds to step S15. In step S15, theoutput direction determination unit 24 determines, as the outputdirection, the opposite direction as the input direction acquired by theinput direction acquisition unit 22 in step S11 and performsnotification to the display instruction unit 25.

After the processing of step S14 or S15, the process proceeds to stepS16 and the display instruction unit 25 supplies the display unit 16with a control signal that instructs display of the display screen suchthat display on the display screen of the display unit 16 is changed inthe output direction determined by the output direction determinationunit 24. After the processing of step S16, the operation processing isended.

As mentioned above, the touch operation terminal 11 determines theorientation of the output direction with respect to the input directionaccording to the relative angle θ and switches the output direction,thereby providing an easier-to-use user interface with no sense ofincongruity upon operation of the user.

The touch operation terminal 11 may display an icon or an indicator onthe display unit 16 so as to present, to the user, the switching of theorientation of the output direction with respect to the input direction.Also, it may be possible to enable the user to recognize that theorientation of the output direction with respect to the input directionis switched, through mechanism of the hinge part 14.

Also, the touch operation terminal 11 can apply the same operationprocessing to a zoom operation by detecting touches of a plurality ofpoints, in addition to the swipe operation. It may be possible to changethe relative angle θ of the input unit 15 and the display unit 16 by amechanical configuration other than the hinge part 14. Furthermore, itmay be possible to detect torsion of the input unit 15 and the displayunit 16 to perform the operation processing.

Note that it is possible to apply not only a straight direction but alsoa rotational direction as the input direction and the output direction.For example, when the input direction is clockwise, the touch operationterminal 11 can determine a clockwise direction as the output directionwhen the relative angle θ is in the predetermined range, and determinesa counterclockwise direction as the output direction when the relativeangle θ is not in the predetermined range. The touch operation terminal11 can detect touches of a plurality of points to input a rotationdirection, and detect a touch of one point and detect a rotation of afinger that is touching the one point to input the rotation direction.

The angle of the predetermined range at which the output direction withrespect to the input direction is switched is not limited to 180°, andcan be set to an appropriate angle according to an application programthat is executed in the touch operation terminal 11 and a structure ofthe touch operation terminal 11. The angle of the predetermined rangemay be different depending on operations of opening and closing betweenthe input unit 15 and the display unit 16.

Furthermore, the touch operation terminal 11 can employ a configurationin which the input unit 15 and the display unit 16 are independent ofeach other, in addition to a configuration in which the input unit 15and the display unit 16 are connected to each other through the hingepart 14. In this case, the input unit 15 and the display unit 16respectively include an acceleration sensor to detect a relativeposition to enable the output direction with respect to the inputdirection to be switched.

Also, the input unit 15 is not limited to a device equipped with a touchsensor and it is possible to employ various types of input devices, suchas a button, a dial, and a wheel, that is an input device capable ofindicating a direction.

The touch operation terminal 11 can adjust a change amount by which thedisplay on the display screen of the display unit 16 is changed, withrespect to an input amount of the swipe operation on the input unit 15(that is a movement amount by which the user moves a finger whilemaintaining a touched state), based on a magnitude of the relative angleθ. For example, the touch operation terminal 11 performs the operationprocessing to increases a scroll speed of the display screen withrespect to the input amount of the swipe operation when the relativeangle θ is large and to decrease the scroll speed of the display screenwith respect to the input amount of the swipe operation when therelative angle θ is small. Similarly, the touch operation terminal 11can perform the operation processing to adjust a speed at which a cursoron the display screen is moved with respect to the input amount of theswipe operation, according to the magnitude of the relative angle θ.

Furthermore, the touch operation terminal 11 can adjust the scroll speedof the display screen or adjust a speed at which the cursor that isdisplayed on the display screen is moved, according to the positionrelationship between the user and the display unit 16.

With reference to FIGS. 6A and 6B, there will be described a processthat adjusts the scroll speed of the display screen in the display unit16 according to the position relationship between the user and thedisplay unit 16.

FIG. 6A illustrates a state where a user faces a front side of thedisplay unit 16, and FIG. 6B illustrates a state where the user facesinclined to the display unit 16.

The touch operation terminal 11 can include, for example, an imagepickup device (not illustrated) and detect the relative angle between aneye E of the user and the display unit 16 from an image picked up by theimage pickup device. In the state where the user faces the front side ofthe display unit 16 (FIG. 6A), the relative angle between the eye E ofthe user and the display unit 16 is detected as being 90°, and the touchoperation terminal 11 scrolls the display screen of the display unit 16in the above-described output direction at a predetermined scroll speedV.

On the other hand, in the state (FIG. 6B) where the user faces inclinedto the display unit 16, the relative angle between the eye E of the userand the display unit 16 is detected as being an angle θ. At this time,when the display screen is scrolled at the scroll speed V, a scrollspeed in a vertical direction viewed by the user becomes V×Sinϕ. Thatis, since the user faces inclined to the display unit 16, the scrollspeed in the vertical direction is viewed as being slower than thescroll speed V in the state where the user faces the front side of thedisplay unit 16.

Therefore, the touch operation terminal 11 sets the scroll speed V′after compensation to V′=V×(1/Sinϕ) in order to compensate for an amountby which the scroll speed is reduced. In this way, the scroll speed inthe vertical speed as being viewed by the user becomes a scroll speed V(=V×Sinϕ×(1/Sinϕ)). Thus, the touch operation terminal 11 can scroll thedisplay screen of the display unit 16 at the scroll speed V′ to whichthe scroll speed V is adjusted according to the angle ϕ.

In this way, the touch operation terminal 11 can adjust the scroll speedof the display screen of the display unit 16 with respect to the inputamount of the swipe operation on the input unit 15, according to theangle ϕ, thereby providing the easier-to-use user interface.

Also, the touch operation terminal 11 may adjust a movement speed of acursor displayed on the display unit 16 with respect to the input amountof the swipe operation on the input unit 15, according to the angle ϕ.

The touch operation terminal 11 is not limited to the configurationhaving the hinge part 14 as illustrated in FIG. 1. For example, thetouch operation terminal 11 can employ a configuration havingflexibility to be flexibly bendable at an arbitrary position and capableof changing the relative angle θ between the input unit 15 and thedisplay unit 16 at an arbitrary position.

FIGS. 7A and 7B are perspective views illustrating an exampleconfiguration of a second embodiment of a touch operation terminal towhich the present technology is applied. FIG. 7A illustrates a frontsurface side of the touch operation terminal 51, and FIG. 7B illustratesa rear surface side of the touch operation terminal 51.

The touch operation terminal 51 is entirely made of a thin body 52 thatis flexible and bendable, and is configured such that the display unit53 is disposed at the front surface side of the body 52 and the inputunit 54 is disposed at the rear surface side of the body 52. That is,the display unit 53 and the input unit 54 are disposed to face oppositesides to each other.

In the operation processing of the touch operation terminal 51, theinput direction and the output direction are opposite to each othersimilarly to a state where the relative angle θ is 360° as illustratedin FIG. 3D.

The display unit 53, which is a flexible display, controls display ofthe display screen in the output direction, the orientation of which isswitched with respect to the input direction according to the relativeangle θ similarly to the display unit 16 of FIG. 1. The input unit 54,which is a flexible touch panel, acquires operation informationindicating the input direction according to the swipe operation of theuser, similarly to the input unit 15 of FIG. 1. Although notillustrated, the touch operation terminal 51 includes the operationprocessing unit 21 (FIG. 2) which is implemented by a flexible board andis embedded in the body 52.

As illustrated in FIG. 8, the touch operation terminal 51 can beflexibly bent at an arbitrary position and therefore, a portion of theinput unit 54 can be in a state of facing in a direction toward thedisplay unit 53 (toward the front surface). That is, when the touchoperation terminal 51 is bent, the relative angle between the displayunit 53 and the input unit 54 is changed, and the relative angle isdetectable by the relative angle detection unit 23 of the operationprocessing unit 21. Therefore, when the relative angle detection unit 23detects the relative angle at which the portion of the input unit 54 isin the state of facing the direction toward the display unit 53, animage is displayed on the portion of the input unit 54 (in FIG. 8, aportion facing the front of the paper) in the touch operation terminal51. Also, the portion of the input unit 54 can input a swipe operationby a user.

In this case, the output direction with respect to the input directionis switched respectively upon the swipe operation on the portion of theinput unit 54 facing the front surface side and the swipe operation onthe portion of the input unit 54 facing the rear surface side. That is,the operation processing is performed on the portion of the input unit54 which is determined as facing the front surface side according to therelative angle detected by the relative angle detection unit 23 suchthat the input direction is the same direction as the output direction.

Also, by bending the touch operation terminal 51, the portion of theinput unit 54 faces the front surface side and an area of the rearportion of the touch operation terminal 51, that is, an area of theinput unit 54 facing the rear surface side becomes narrow. The aboveconfiguration is similarly applied to a case where the touch operationterminal 51 is in a state of being bent in the opposite direction ofFIG. 8, that is, a portion of the display unit 53 is in a state offacing a direction toward the input unit 54 (toward the rear surfaceside).

Additionally, the touch operation terminal 51 can change the userinterface that is displayed when the display unit 53 and the input unit54 are bent.

That is, as illustrated in FIG. 9, the touch operation terminal 51 candisplay a menu screen 55 used to perform an operation with respect tothe display screen that is being displayed on the display unit 53 on aportion of the input unit 54 facing in the front surface side by bendingthe display unit 53 and the input unit 54. One or a plurality ofgraphical user interfaces (GUI) can be displayed on the menu screen 55.

Thus, in the touch operation terminal 51, the menu screen 55 isdisplayed when bending is detected. Additionally, the touch operationterminal 51 can detect a bendable position, change the size of the menuscreen 55 according to the position, and change the number of GUIs to bedisplayed on the menu screen 55. Accordingly, when the portion of theinput unit 54 that is facing the front surface side become large bybending the touch operation terminal 51, the menu screen 55 is largelydisplayed and many GUIs are displayed on the menu screen 55.

Also, the touch operation terminal 51 may adjust an output amount (forexample, scroll speed) with respect to an input amount in addition toswitching of the output direction with respect to the input direction,according to an angle at which the display unit 53 and the input unit 54are bent. Furthermore, the touch operation terminal 51 is not only bentto be folded into two portions as illustrated in FIGS. 8 and 9, but isalso capable of being folded to divided into three or four portions, andoperation processing may be different according to respective foldingmethods.

The touch operation terminal 51 may employ a semi-transparent member asthe display unit 53 and the input unit 54, so that the display unit 53may be visible through the input unit 54 when the touch operationterminal 51 is bent.

It should be noted that each process described referring to theflowchart above includes a process that is not necessarily performed ina time series manner in the order described in the flowchart, but may beperformed in a parallel or individual manner (for example, a paralleledprocess or a process by objects). In addition, the program may beprocessed by one CPU, or processed by a plurality of CPUs in adistributed manner.

The above-described series of processing (an information processingmethod) may be performed by hardware or may be performed by software.When the series of processing is performed by software, a programforming the software is installed into a computer that is incorporatedin a dedicated hardware, or installed from a program storage medium onwhich programs are recorded into a general-purpose computer or the likethat can perform various types of functions by installing various typesof programs.

FIG. 10 is a block diagram showing an example configuration of thehardware of a computer that executes the series of processes describedearlier according to a program.

In a computer 101, a CPU 102, a ROM 103, a RAM 104, and an EEPROM 105are connected to one another through a bus 106. An input/outputinterface 107 is connected to the bus 106, and an external device, forexample, the input unit 15 and the display unit 16 of FIG. 1 areconnected to the input/output interface 107.

In the computer 101 configured as mentioned above, the CPU 102 loads aprogram stored in, for example, the ROM 103 or the EEPROM 105 into theRAM 104 through the bus 106 and executes the program, thereby performingthe above-described series of processing. Also, the program which isexecuted by the computer (CPU 102) can be provided through, for example,non-illustrated other recording mediums which are previously stored inthe ROM 103 and the EEPROM 105 or various types of communicationnetworks, and can be installed in the EEPROM 105. Additionally, thepresent technology may also be configured as below.

(1)

An operation processing device including:

an input direction acquisition unit configured to acquire informationindicating an input direction according to a direction generated inresponse to an operation indicating the direction which is performed onan input unit to which the operation is input;

an output direction indication unit configured to indicate, to a displayunit configured to display an image, an output direction that is adirection in which the image of the display unit is changed in responseto the operation on the input unit; and

a determination unit configured to determine an orientation of theoutput direction with respect to the input direction according to arelative position relationship between the input unit and the displayunit.

(2)

The operation processing device according to (1), further including:

a connection part configured to connect the input unit and the displayunit to be openable and closeable,

wherein the determination unit determines the orientation of the outputdirection with respect to the input direction according to a relativeangle between the input unit and the display unit with the connectionpart as a center.

(3)

The operation processing device according to (1) or (2),

wherein the connection part connects the input unit and the display unitso as to be openable and closeable in a range from an angle at which theinput unit and the display unit face each other to an angle at which theinput unit and the display unit face opposite sides to each other.

(4)

The operation processing device according to any of (1) to (3),

wherein an output amount in the output direction with respect to aninput amount in the input direction is adjusted according to therelative position relationship between the input unit and the displayunit.

(5)

The operation processing device according to any of (1) to (4),

wherein an output amount in the output direction with respect to aninput amount in the input direction is adjusted according to a relativeposition relationship between a user which performs input on the inputunit and the display unit.

(6)

The operation processing device according to any of (1) to (5),

wherein the input unit and the display unit are configured to haveflexibility to be flexibly bendable at an arbitrary position and aredisposed to face opposite sides to each other.

(7)

The operation processing device according to any of (1) to (6),

wherein, when the input unit and the display unit are bent, and aportion of the input unit is in a state of facing in a direction towardthe display unit, an image is displayed on the portion of the input unitfacing in the same direction of the display unit.

(8)

The operation processing device according to any of (1) to (7),

wherein an image that becomes an interface when an operation isperformed on the image displayed on the display unit is displayed on theportion of the input unit facing in the same direction of the displayunit.

(9)

The operation processing device according to any of (1) to (8),

wherein content of an interface of an operation screen that is the imagedisplayed on the portion of the input unit is changed according to aposition at which the input unit and the display unit are bent.

Incidentally, the embodiment of the present disclosure is not limited tothe above embodiment and various modifications may be made withoutdeparting from the spirit and scope of the present disclosure.

REFERENCE SIGNS LIST

11 touch operation terminal

12 first housing

13 second housing

14 hinge part

15 input unit

16 display unit

21 operation processing unit

22 input direction acquisition unit

23 relative angle detection unit

24 output direction determination unit

25 display instruction unit

51 touch operation terminal

52 body

53 display unit

54 input unit

1. An information processing apparatus, comprising: a detection unit configured to detect whether the information processing apparatus is folded; a first touch panel display; a second touch panel display which is arranged in a back side of the first touch panel display and configured to be folded in a first state that a portion of the second touch panel display is facing a same direction of the first touch panel display; and circuitry configured to: receive operation information of the second touch panel display; and control a display of the second touch panel display based on the operation information and the detection unit.
 2. The information processing apparatus according to claim 1, wherein the portion of the second touch panel display is controllable based on a swipe operation of the second touch panel display, when the second touch panel display is folded in the first state.
 3. The information processing apparatus according to claim 1, wherein when the second touch panel display is folded in the first state, a portion of the display of the first touch panel display is controllable based on an operation of the portion of the second touch panel display.
 4. The information processing apparatus according to claim 1, wherein the circuitry is further configured to: control display of a menu screen on the second touch panel display, wherein: the menu screen is displayed on the portion of the second touch panel display, the second touch panel display face a front surface side, and the displayed menu screen includes a plurality of Graphical User Interfaces (GUIs).
 5. The information processing apparatus according to claim 4, wherein the circuitry is further configured to: control the display of the menu screen, on the second touch panel display, based on the detection, detect a bendable position of the second touch panel display, change a size of the menu screen based on the detected bendable position, and change a number of the GUIs displayed on the menu screen.
 6. The information processing apparatus according to claim 5, wherein: the circuitry is further configured to control the display of the menu screen based on the portion of the second touch panel display that is enlarged, the second touch panel display faces a front surface side of the information processing apparatus, and the second touch panel display is enlarged based on the detection .
 7. An information processing method, comprising: in an information processing apparatus comprising a first touch panel display, and a second touch panel display which is arranged in a back side of the first touch panel display and configured to be folded in a first state that a portion of the second touch panel display is facing a same direction of the first touch panel display: detecting, by a detection unit, whether the information processing apparatus is folded; receiving, by circuitry, operation information of the second touch panel display; and controlling, by the circuitry, a display of the first touch panel display based on the operation information and the detection unit.
 8. A non-transitory computer-readable medium having stored thereon computer-executable instructions, which when executed by a processor of an information processing apparatus, cause the processor to execute operations, the operations comprising: in the information processing apparatus comprising a first touch panel display, and a second touch panel display which is arranged in a back side of the first touch panel display and configured to be folded in a first state that a portion of the second touch panel display is facing a same direction of the first touch panel display: detecting whether the information processing apparatus is folded; receiving operation information of the second touch panel display; and controlling a display of the first touch panel display based on the operation information and the detection. 